Papers with unlearning process
Revisiting Who’s Harry Potter: Towards Targeted Unlearning from a Causal Intervention Perspective (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing and new datasets show that our approach achieves competitive performance in all of the criteria. |
| Approach: | They propose a new task of LLM targeted unlearning where unlearning targets only the information about the unlearning target, rather than everything in the unlearned documents. |
| Outcome: | The proposed method achieves competitive performance on existing and new datasets without optimizing for the aforementioned criteria. |
Safety Alignment via Constrained Knowledge Unlearning (2025.acl-long)
Copied to clipboard
Zesheng Shi, Yucheng Zhou, Jing Li, Yuxin Jin, Yu Li, Daojing He, Fangming Liu, Saleh Alharbi, Jun Yu, Min Zhang
| Challenge: | Existing defense mechanisms have not fully deleted harmful knowledge in large language models (LLMs) Existing methods to address safety alignment have not completely deleted harmful information in LLMs. |
| Approach: | They propose a safety alignment strategy that uses scoring neurons to identify useful knowledge in LLMs and pruning the gradients of neurons in U to preserve beneficial information. |
| Outcome: | The proposed method significantly improves model safety while maintaining utility compared to existing methods. |